Display control device, display control method, and non-transitory computer readable medium

ABSTRACT

A display control device according to the present invention includes: a processor; and a memory storing a program which, when executed by the processor, causes the display control device to acquire a captured image including a first image region and a second image region, wherein the first image region is inside an image circle and the second image region is outside the image circle, perform predetermined image processing on the captured image, and perform control so that an image after the predetermined image processing is displayed in a state where the predetermined image processing is performed on the first image region and is not performed on the second image region so as to be distinguishable a boundary between the first image region and the second image region.

BACKGROUND OF THE INVENTION Field of the Invention

The present invention relates to a display control device, a displaycontrol method, and a non-transitory computer readable medium.

Description of the Related Art

Digital cameras having two optical systems have been known. Such digitalcameras are capable of capturing, for example, an image in which twoimage regions having parallax are arranged on right and left sides(Japanese Patent Application Laid-open No. 2022-046260). In this image,a non-image region (ineffective region) exists around two image regions(effective regions).

Further, color conversion processing (false-color processing) to convertthe colors of respective pixels of an input image into colorscorresponding to the brightness levels of the pixels has been known(Japanese Patent Application Laid-open No. 2020-109914). For example,the false-color processing converts black (having a brightness level of0% and including black saturation) into blue and facilitates theconfirmation of an exposed state.

However, conventional technologies may not display an image after apredetermined image processing (for example, false-color processing) toa captured image including an image region and a non-image region in asuitable state in some cases.

SUMMARY OF THE INVENTION

The present invention provides a technique capable of displaying animage based on a captured image including image regions and a non-imageregion in a suitable state.

A display control device according to the present invention includes: aprocessor; and a memory storing a program which, when executed by theprocessor, causes the display control device to acquire a captured imageincluding a first image region and a second image region, wherein thefirst image region is inside an image circle and the second image regionis outside the image circle, perform predetermined image processing onthe captured image, and perform control so that an image after thepredetermined image processing is displayed in a state where thepredetermined image processing is performed on the first image regionand is not performed on the second image region, so as to bedistinguishable a boundary between the first image region and the secondimage region.

Further features of the present invention will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A and 1B are external views of a camera;

FIG. 2 is a block diagram showing the configuration of the camera;

FIG. 3 is a schematic diagram showing the configuration of a lens unit;

FIG. 4 is a diagram showing the meanings of respective colors(conversion colors) after false-color processing;

FIG. 5 is a diagram showing a display image according to a firstembodiment;

FIG. 6 is a flowchart showing LV display processing according to thefirst embodiment;

FIG. 7 is a flowchart showing LV display processing according to asecond embodiment;

FIG. 8 is a diagram showing a display image according to a thirdembodiment; and

FIG. 9 is a flowchart showing LV display processing according to thethird embodiment.

DESCRIPTION OF THE EMBODIMENTS

Hereinafter, embodiments of the present invention will be described withreference to the drawings. The present embodiment will describe a casein which electronic equipment is a digital camera (imaging device) as anexample. The digital camera according to the present embodiment iscapable of acquiring one image (two-lens image) including a left-imageregion and a right-image region having predetermined parallax in aright-and-left direction and displaying the acquired image on a displayunit.

FIGS. 1A and 1B are external views showing an example of the appearanceof a digital camera (camera) 100 according to the present embodiment.FIG. 1A is a perspective view of the camera 100 when viewed from itsfront-surface side, and FIG. 1B is a perspective view of the camera 100when viewed from its back-surface side.

The camera 100 has a shutter button 101, a power switch 102, a modeselection switch 103, a main electronic dial 104, a sub-electronic dial105, a moving-image button 106, and a display unit 107 outside a finderon its top surface. The shutter button 101 is an operation member usedto provide photographing preparation instructions or photographinginstructions. The power switch 102 is an operation member used to switchbetween the ON and OFF states of the power of the camera 100. The modeselection switch 103 is an operation member used to select variousmodes. The main electronic dial 104 is a rotary operation member used tochange a setting value of a shutter speed, an aperture, or the like. Thesub-electronic dial 105 is a rotary operation member used to perform themovement of a selected frame (cursor), image feeding, or the like. Themoving-image button 106 is an operation member used to provideinstructions to start or stop photographing (recording) moving images.The display unit 107 outside the finder displays various setting valuesof a shutter speed, an aperture, or the like.

The camera 100 has a display unit 108, a touch panel 109, a directionkey 110, a SET button 111, an AE lock button 112, an enlargement button113, a reproduction button 114, a menu button 115, an eyepiece unit 116,an eyepiece detection unit 118, a touch bar 119, a multi-controller 120,and a display-mode selection button 121 on its back surface. The displayunit 108 displays an image or various information. The touch panel 109is an operation member used to detect a touch operation on the displaysurface (touch operation surface) of the display unit 108. The directionkey 110 is an operation member composed of keys (four direction keys)capable of being pressed in both a top-and-bottom direction and aright-and-left direction. It is possible to perform processingcorresponding to a position at which the direction key 110 is pressed.The SET button 111 is an operation member pressed mainly when a selecteditem is determined. The AE lock button 112 is an operation memberpressed when an exposed state is fixed in a photographing standby state.The enlargement button 113 is an operation member used to switch betweenthe ON and OFF states of an enlargement mode in the live-view display(LV display) of a photographing mode. When the enlargement mode is ON, alive-view image (LV image) is enlarged or contracted by the operation ofthe main electronic dial 104. Further, the enlargement button 113 isused to enlarge a reproduction image or increase a magnification ratioin a reproduction mode. The reproduction button 114 is an operationmember used to switch between a photographing mode and a reproductionmode. The photographing mode is switched to the reproduction mode whenthe reproduction button 114 is pressed, and the latest image amongimages recorded on a recording medium 227 that will be described latermay be displayed on the display unit 108.

The menu button 115 is an operation member pressed to display a menuscreen enabling various settings on the display unit 108. A user mayintuitively perform various settings using the menu screen displayed onthe display unit 108 and the direction key 110 or the SET button 111.The eyepiece unit 116 is a portion at which an eye of the user is incontact with and looks into an eyepiece finder (looking-into typefinder) 117. Through the eyepiece unit 116, the user may visuallyrecognize video displayed on an EVF 217 (Electronic View Finder) insidethe camera 100 that will be described later. The eyepiece detection unit118 is a sensor used to detect whether an eye of the user is in contactwith the eyepiece unit 116 (the eyepiece finder 117).

The touch bar 119 is a linear touch-operation member (line touch sensor)capable of receiving a touch operation. The touch bar 119 is arranged ata position (touchable position) at which the user is capable ofperforming a touch operation with the thumb of a right hand whileholding a grip unit 122 with the right hand (i.e., holding the grip unit122 with the little finger, the ring finger, and the middle finger ofthe right hand) so as to enable the pressing of the shutter button 101with the index finger of the right hand. That is, the touch bar 119 isoperable in a state (photographing state) in which the user holds thecamera 100 up so that an eye of the user is in contact with the eyepiecefinder 117 and looks into the eyepiece unit 116 to enable the pressingof the shutter button 101 at all times. The touch bar 119 is capable ofreceiving a tap operation (the operation of releasing the thumb of theright hand without moving from a touched position for a predeterminedperiod of time after touching) thereon, a slide operation (the operationof moving a touched position while holding a touched state aftertouching) in a right-and-left direction, or the like. The touch bar 119is an operation member different from the touch panel 109 and does notinclude a display function. The touch bar 119 functions as, for example,a multi-function bar (M-Fn bar) to which various functions areallocatable.

The multi-controller 120 is configured to be capable of being pusheddown in all directions. The user may indicate eight directions such as avertical direction and a horizontal direction by pushing down themulti-controller 120. Further, the user may indicate the exercise of afunction allocated to the multi-controller 120 by pressing in themulti-controller 120. The display-mode selection button 121 is anoperation member used to select a display mode of an image (including alive-view image), photographing information, or the like to be displayedon the display unit 108 or the EVF 217. A display mode is switched everytime the display-mode selection button 121 is pressed, and the user isenabled to visually recognize an image or information in a desireddisplay mode.

Further, the camera 100 has a grip unit 122, a thumb-rest unit 123, aterminal cover 124, a lid 125, a communication terminal 126, or thelike. The grip unit 122 is a holding unit formed into a shape easilygripped by the right hand when the user holds the camera 100 up. Theshutter button 101 and the main electronic dial 104 are arranged atpositions at which the user is capable of performing an operation withthe index finger of the right hand while holding the camera 100 with thegrip unit 122 gripped with the little finger, the ring finger, and themiddle finger of the right hand. Further, in the same state, thesub-electronic dial 105 and the touch bar 119 are arranged at positionsat which the user is capable of performing an operation with the thumbof the right hand. The thumb-rest unit 123 (thumb standby position) is agrip unit provided at a place at which the user is enabled to easily putthe thumb of the right hand gripping the grip unit 122 in a state inwhich he/she does not operate the operation members on the back-surfaceside of the camera 100 at all. The thumb-rest unit 123 is composed of arubber member or the like for increasing a holding force (grip feeling).The terminal cover 124 protects a connector such as a connection cablethat connects the camera 100 to external equipment (external device).The lid 125 closes a slot for storing the recording medium 227 that willbe described later to protect the recording medium 227 and the slot. Thecommunication terminal 126 is a terminal used to perform communicationwith the side of a lens unit (a lens unit 200 or a lens unit 300 thatwill be described later) attachable to and detachable from the camera100.

FIG. 2 is a block diagram showing an example of the configuration of thecamera 100. Note that the same constituting elements as those of FIGS.1A and 1B are denoted by the same symbols, and their descriptions willbe appropriately omitted. In FIG. 2 , the lens unit 200 is attached tothe camera 100.

First, the lens unit 200 will be described. The lens unit 200 is a typeof a replaceable lens unit attachable to and detachable from the camera100. The lens unit 200 is a single-lens unit (monocular lens unit) andshows an example of a normal lens unit. The lens unit 200 has anaperture 201, a lens 202, an aperture driving circuit 203, an AF (AutoFocus) driving circuit 204, a lens-system control circuit 205, acommunication terminal 206, or the like.

The aperture 201 is configured to be capable of adjusting an aperturediameter. The lens 202 is composed of a plurality of lenses. Theaperture driving circuit 203 adjusts a light amount by controlling theaperture diameter of the aperture 201. The AF driving circuit 204 drivesthe lens 202 to obtain focus. The lens-system control circuit 205controls the aperture driving circuit 203, the AF driving circuit 204,or the like on the basis of instructions from a system control unit 50that will be described later. The lens-system control circuit 205controls the aperture 201 via the aperture driving circuit 203. Further,the lens-system control circuit 205 obtains focus by changing theposition of the lens 202 via the AF driving circuit 204. The lens-systemcontrol circuit 205 is capable of performing communication with thecamera 100. Specifically, communication is performed via thecommunication terminal 206 of the lens unit 200 and the communicationterminal 126 of the camera 100. The communication terminal 206 is aterminal used when the lens unit 200 performs communication with theside of the camera 100.

Next, the camera 100 will be described. The camera 100 has a shutter210, an imaging unit 211, an A/D convertor 212, a memory control unit213, an image processing unit 214, a memory 215, a D/A convertor 216, anEVF 217, a display unit 108, and a system control unit 50.

The shutter 210 is a focal-plane shutter capable of freely controllingan exposure time of the imaging unit 211 on the basis of instructionsfrom the system control unit 50. The imaging unit 211 is an imagingelement (image sensor) composed of a CCD element, a CMOS element, or thelike that converts an optical image into an electric signal. The imagingunit 211 may have an imaging-surface phase-difference sensor thatoutputs defocus-amount information to the system control unit 50. TheA/D convertor 212 converts an analog signal output from the imaging unit211 into a digital signal. The image processing unit 214 performspredetermined image processing (resize processing such as pixelinterpolation and contraction, color conversion processing, or the like)on data from the A/D convertor 212 or data from the memory control unit213. Further, the image processing unit 214 performs predeterminedcomputation processing using data on a captured image, and the systemcontrol unit 50 performs exposure control or ranging control on thebasis of an obtained computation result. By this processing, AFprocessing of a TTL (Through-The-Lens) system, AE (Automatic Exposure)processing, EF (Electronic Flash Pre-Emission) processing, or the likeis performed. Moreover, the image processing unit 214 performspredetermined computation processing using data on a captured image, andthe system control unit 50 performs AWB (Automatic White Balance)processing of a TTL system on the basis of an obtained computationresult.

Image data from the A/D convertor 212 is written into the memory 215 viathe image processing unit 214 and the memory control unit 213.Alternatively, image data from the A/D convertor 212 is written into thememory 215 via the memory control unit 213 without going through theimage processing unit 214. The memory 215 stores image data that hasbeen obtained by the imaging unit 211 and converted into digital data bythe A/D convertor 212 or image data that is to be displayed on thedisplay unit 108 or the EVF 217. The memory 215 includes storagecapacity enough to store a predetermined number of still images ormoving images and sounds for a predetermined period of time. Further,the memory 215 serves also as a memory (video memory) for displayingimages.

The D/A convertor 216 converts image data for display stored in thememory 215 into an analog signal and supplies the converted signal tothe display unit 108 or the EVF 217. Accordingly, image data for displaywritten into the memory 215 is displayed on the display unit 108 or theEVF 217 via the D/A convertor 216. The display unit 108 or the EVF 217performs display according to an analog signal from the D/A convertor216. The display unit 108 or the EVF 217 is, for example, a display suchas an LCD and an organic EL display. When a digital signal that has beenA/D-converted by the A/D convertor 212 and accumulated in the memory 215is converted into an analog signal by the D/A convertor 216 andsequentially transferred to and displayed on the display unit 108 or theEVF 217, live-view display is performed.

The system control unit 50 is a control unit including at least oneprocessor and/or at least one circuit. That is, the system control unit50 may be a processor, a circuit, or a combination of a processor and acircuit. The system control unit 50 controls the whole camera 100. Thesystem control unit 50 realizes the respective processing of flowchartsthat will be described later by running a program recorded on anon-volatile memory 219. Further, the system control unit 50 performsalso display control by controlling the memory 215, the D/A convertor216, the display unit 108, the EVF 217, or the like. The system controlunit 50 is capable of identifying the type of a lens unit attached tothe camera 100 by performing communication via the communicationterminal 126 and the communication terminal 206.

Further, the camera 100 has a system memory 218, a non-volatile memory219, a system timer 220, a communication unit 221, an orientationdetection unit 222, and an eyepiece detection unit 118.

As the system memory 218, a RAM is, for example, used. Into the systemmemory 218, a constant for operating the system control unit 50, avariable, a program read from the non-volatile memory 219, or the likeis developed. The non-volatile memory 219 iselectrically-erasable/recordable memory, and an EEPROM is, for example,used as the non-volatile memory 219. On the non-volatile memory 219, aconstant for operating the system control unit 50, a program, or thelike is recorded. Here, the program refers to a program for running theflowcharts that will be described later. The system timer 220 is aclocking unit that measures time used in various control or time of anembedded clock. The communication unit 221 performs the transmission andreception of a video signal or a sound signal with external equipmentconnected via a wireless or wired cable. The communication unit 221 isconnectable also to a wireless LAN (Local Area Network) or the Internet.Further, the communication unit 221 is communicable with externalequipment through Bluetooth™ or Bluetooth Low Energy. The communicationunit 221 is capable of transmitting an image (including a live-viewimage) that has been captured by the imaging unit 211 or an image thathas been recorded on the recording medium 227, and capable of receivingan image or various other information from external equipment. Theorientation detection unit 222 detects the orientation (inclination) ofthe camera 100 with respect to a gravity direction. On the basis of anorientation detected by the orientation detection unit 222, aninclination angle in the horizontal (a right-and-left direction) or thevertical direction (the top-and-bottom direction; the front-and-backdirection) of the camera 100 is detectable. Further, on the basis of anorientation detected by the orientation detection unit 222, it ispossible to discriminate whether an image that has been captured by theimaging unit 211 is an image that has been captured when the camera 100is held in horizontal orientation or an image that has been capturedwhen the camera 100 is held in vertical orientation. The system controlunit 50 is capable of adding direction information corresponding to anorientation that has been detected by the orientation detection unit 222to an image file of an image that has been captured by the imaging unit211, or capable of rotating an image according to a detectedorientation. It is also possible to detect the movement (pan, tilt,lifting, standing-still, or the like) of the camera 100 using theorientation detection unit 222. As the orientation detection unit 222,an acceleration sensor, a gyro sensor, or the like is, for example,usable.

The eyepiece detection unit 118 is capable of detecting the approach ofany object toward the eyepiece unit 116 (the eyepiece finder 117). Asthe eyepiece detection unit 118, an infrared proximity sensor is, forexample, usable. When an object approaches the eyepiece unit 116,infrared light projected from the projection unit of the eyepiecedetection unit 118 is reflected at the object and received by thelight-receiving unit of the infrared proximity sensor. On the basis ofthe amount of the received infrared light, a distance from the eyepieceunit 116 to the object is discriminable. As described above, theeyepiece detection unit 118 performs eyepiece detection to detect theproximity distance of an object with respect to the eyepiece unit 116.The eyepiece detection unit 118 is an eyepiece detection sensor thatdetects the approach (contact) and regression (separation) of an eye(object) with respect to the eyepiece unit 116. When an objectapproaching the eyepiece unit 116 within a predetermined distance isdetected from a non-contacting state (non-approaching state), theeyepiece detection unit 118 detects the contact of the object. On theother hand, when the object having approached the eyepiece unit 116 isseparated by at least a predetermined distance from a contacting state(approaching state), the eyepiece detection unit 118 detects theseparation of the object. A threshold for detecting contact and athreshold for detecting separation may be different from each other by,for example, setting hysteresis or the like. Further, after thedetection of contact, it is assumed that a contacting state ismaintained until separation is detected. After the detection of theseparation, it is assumed that a non-contacting state is maintaineduntil contact is detected. The system control unit 50 switches betweenthe display (display state) and non-display (non-display state) of thedisplay unit 108 and the EVF 217 according to a state detected by theeyepiece detection unit 118. Specifically, when the camera 100 is in atleast a photographing standby state and when the switching of a displaydestination is set to automatic switching, the display unit 108 isturned ON as a display destination and the EVF 217 is hidden in anon-contacting state. Further, the EVF 217 is turned ON as a displaydestination and the display unit 108 is hidden in a contacting state.Note that the eyepiece detection unit 118 is not limited to an infraredproximity sensor, but any sensor may be used as the eyepiece detectionunit 118 so long as it is capable of detecting a state regarded ascontact.

Further, the camera 100 has the display unit 107 outside the finder, adriving circuit 223 for the display unit 107 outside the finder, a powercontrol unit 224, a power unit 225, a recording medium I/F 226, anoperation unit 228, or the like.

The display unit 107 outside the finder is driven by the driving circuit223 for the display unit 107 outside the finder and displays varioussetting values of a shutter speed, an aperture, or the like of thecamera 100. The power control unit 224 is composed of a batterydetection circuit, a DC-DC convertor, a switch circuit that switches ablock to be energized, or the like and detects the presence or absenceof the installation of a battery, the type of a battery, the remainingamount of a battery, or the like. Further, the power control unit 224controls the DC-DC convertor on the basis of the result of the detectionand instructions from the system control unit 50 and supplies a requiredvoltage to respective units including the recording medium 227 for arequired period. The power unit 225 is a primary battery such as analkali battery and a lithium battery, a secondary battery such as anNiCd battery, an NiMH battery, and an Li battery, an AC adapter, or thelike. The recording medium I/F 226 is an interface with the recordingmedium 227 such as a memory card and a hard disk. The recording medium227 is a memory card or the like for recording a captured image andcomposed of a semiconductor memory, a magnetic disk, or the like. Therecording medium 227 may be attachable to and detachable from the camera100, or may be embedded in the camera 100.

The operation unit 228 is an input unit that receives an operation (useroperation) from the user and used to input various instructions to thesystem control unit 50. The operation unit 228 includes the shutterbutton 101, the power switch 102, the mode selection switch 103, thetouch panel 109, other operation units 229, or the like. The operationunits 229 include the main electronic dial 104, the sub-electronic dial105, the moving-image button 106, the direction key 110, the SET button111, the AE lock button 112, the enlargement button 113, thereproduction button 114, the menu button 115, the touch bar 119, or thelike.

The shutter button 101 has a first shutter switch 230 and a secondshutter switch 231. The first shutter switch 230 is turned ON halfwaythrough the operation of the shutter button 101, i.e., half-pressing(photographing preparation instructions), and outputs a first shutterswitch signal SW1. The system control unit 50 starts photographingpreparation processing such as AF processing, AE processing, AWBprocessing, and EF processing according to the first shutter switchsignal SW1. The second shutter switch 231 is turned ON when theoperation of the shutter button 101 is completed, i.e., full-pressing(photographing instructions), and outputs a second shutter switch signalSW2. The system control unit 50 starts a series of photographingprocessing from the reading of a signal from the imaging unit 211 to thewriting of an image file including a photographed image into therecording medium 227 after the generation of the image file according tothe second shutter switch signal SW2.

The mode selection switch 103 switches an operation mode of the systemcontrol unit 50 to any of a still-image photographing mode, amoving-image photographing mode, a reproduction mode, or the like. Thestill-image photographing mode includes an automatic photographing mode,an automatic scene determination mode, a manual mode, an aperturepriority mode (Av mode), a shutter-speed priority mode (Tv mode), and aprogram AE mode (P mode). Further, the still-image photographing modealso includes a various-scenes mode for performing photographingsettings for each photographing scene, a custom mode, or the like. Withthe mode selection switch 103, the user is enabled to directly switchthe operation mode to any of the photographing modes described above.Alternatively, after temporarily switching to the list screen of thephotographing modes with the mode selection switch 103, the user mayselect any of the plurality of the displayed modes using the operationunit 228. Similarly, the moving-image photographing mode may include aplurality of modes.

The touch panel 109 is a touch sensor that detects various touchoperations on the display surface of the display unit 108 (the operationsurface of the touch panel 109). The touch panel 109 and the displayunit 108 may be integrally configured. For example, the touch panel 109has transparency to such an extent that the display of the display unit108 is not disturbed, and is attached to the upper layer of the displaysurface of the display unit 108. Further, input coordinates in the touchpanel 109 and display coordinates on the display surface of the displayunit 108 are associated with each other. Thus, a GUI (Graphical UserInterface) making the user feel as if he/she were capable of directlyoperating a screen displayed on the display unit 108 may be configured.The touch panel 109 may be any of various types of touch panels such asa resistance-film type, a capacitance type, a surface acoustic type, aninfrared type, an electromagnetic induction type, an image recognitiontype, and an optical sensor type. There are a type that detects a touchoperation when the touch panel 109 is touched and a type that detects atouch operation when a finger or a pen approaches the touch panel 109,but any of the types may be used.

The system control unit 50 is capable of detecting the followingoperations or states on the touch panel 109.

-   -   A state in which a finger or a pen that has not touched the        touch panel 109 newly touches the touch panel 109, i.e., the        start of a touch (hereinafter called touch-down).    -   A state in which the touch panel 109 is touched by a finger or a        pen (hereinafter called touch-on).    -   A state in which a finger or a pen moves while touching the        touch panel 109 (hereinafter called touch-move).    -   A state in which a finger or a pen that has touched the touch        panel 109 is separated (released) from the touch panel 109,        i.e., the end of a touch (hereinafter called touch-up).    -   A state in which the touch panel 109 is not touched (hereinafter        called touch-off).

The touch-on is detected simultaneously when the touch-down is detected.Generally, the touch-on is continuously detected unless the touch-up isdetected after the touch-down. The touch-on is continuously detectedwhen the touch-move is detected. Even if the touch-on has been detected,the touch-move is not detected unless a touched position has been moved.After the touch-up of all touched fingers or a pen is detected, thetouch-off is detected.

Via an internal bus, the system control unit 50 is notified of theseoperations and states or position coordinates at which a finger or a penhas touched the touch panel 109. On the basis of notified information,the system control unit 50 determines what operation (touch operation)has been performed on the touch panel 109. For the touch-move, thesystem control unit 50 is also enabled to determine the movementdirection of a finger or a pen that moves on the touch panel 109 foreach of a vertical component and a horizontal component on the touchpanel 109 on the basis of the changes of position coordinates. Thesystem control unit 50 determines that a slide operation has beenperformed when detecting the touch-move by at least a prescribedistance. The operation of quickly moving a finger by a certain distancewhile touching the touch panel 109 and then releasing the same will becalled a flick. In other words, the flick is the operation of quicklytracing the touch panel 109 so as to be flipped with a finger. Thesystem control unit 50 is enabled to determine that the flick has beenperformed when detecting that the touch-move has been performed by atleast a predetermined distance and at least at a predetermined speed andthen the touch-up has been performed in succession to the touch-move(the flick has been performed in succession to the slide operation).Moreover, the touch operation of simultaneously touching a plurality ofplaces (for example, two points) (multi-touch) and making the touchedpositions get close to each other will be called pinch-in, and the touchoperation of making the touched positions get away from each other willbe called pinch-out. The pinch-out and the pinch-in will be genericallycalled a pinch operation (or simply a pinch).

FIG. 3 is a schematic diagram showing an example of the configuration ofthe lens unit 300. FIG. 3 shows a state in which the lens unit 300 isattached to the camera 100. With the lens unit 300 attached thereto, thecamera 100 is enabled to capture one image (a still image or a movingimage) including two image regions having predetermined parallax. Notethat in the camera 100 shown in FIG. 3 , the same constituting elementsas those described in FIG. 2 will be denoted by the same symbols andtheir descriptions will be appropriately omitted.

The lens unit 300 is a type of a replaceable lens unit attachable to anddetachable from the camera 100. The lens unit 300 is a dual-lens unitcapable of capturing a right image and a left image having parallax. Thelens unit 300 has two optical systems (photographing lenses), and eachof the two optical systems is enabled to capture an image with a wideviewing angle of approximately 180 degrees. Specifically, each of thetwo optical systems of the lens unit 300 is enabled to capture an imageof an object with a visual field (viewing angle) of 180 degrees in aright-and-left direction (a horizontal angle, an azimuthal angle, and ayaw angle) and 180 degrees (a vertical angle, an elevation angle, and apitch angle). That is, each of the two optical systems is enabled tocapture an image in a front hemispherical range.

The lens unit 300 has a right-eye optical system 301R having a pluralityof lenses, a reflection mirror, or the like, a left-eye optical system301L having a plurality of lenses, a reflection mirror, or the like, anda lens-system control circuit 303. The right-eye optical system 301R hasa lens 302R arranged on an object side, and the left-eye optical system301L has a lens 302L arranged on the object side. The lens 302R and thelens 302L are oriented in the same direction, and their optical axes aresubstantially parallel to each other. Each of the right-eye opticalsystem 301R and the left-eye optical system 301L has a fish-eye lens andforms a circular optical image on the imaging unit 211. An optical image(right image) formed via the right-eye optical system 301R and anoptical image (left image) formed via the left-eye optical system 301Lare formed on one the imaging surface of the imaging unit 211, and theimaging unit 211 acquires one image including the image regions of therespective optical images.

The lens unit 300 is a dual-lens unit (VR180 lens unit) used to acquirean image in VR180 format that represents one of VR (Virtual Reality)image formats enabling dual-lens stereoscopic vision. The lens unit 300has a fish-eye lens capable of capturing a range of approximately 180degrees in each of the right-eye optical system 301R and the left-eyeoptical system 301L. Note that a range capable of being captured by thelens of each of the right-eye optical system 301R and the left-eyeoptical system 301L may be about 160 degrees narrower than 180 degrees.The lens unit 300 is enabled to form a right image formed via theright-eye optical system 301R and a left image formed via the left-eyeoptical system 301L on one or two imaging elements of a camera to whichthe lens unit 300 is attached. In the camera 100, a right image and aleft image are formed on one imaging element (imaging sensor), and oneimage (dual-lens image) in which a right-image region corresponding tothe right image and a left-image region corresponding to the left imageare arranged from side to side is generated. The dual-lens imageincludes the right-image region, the left-image region, and a region (anon-image region, for example, a black region) not corresponding to anoptical image.

The lens unit 300 is attached to the camera 100 via a lens mount unit304 and a camera mount unit 305 of the camera 100. Thus, the systemcontrol unit 50 of the camera 100 and the lens-system control circuit303 of the lens unit 300 are electrically connected to each other viathe communication terminal 126 of the camera 100 and the communicationterminal 306 of the lens unit 300.

In FIG. 3 , a right image formed via the right-eye optical system 301Rand a left image formed via the left-eye optical system 301L are formedfrom side to side on the imaging unit 211 of the camera 100. That is,two optical images are formed on the two regions of one imaging element(imaging sensor) by the right-eye optical system 301R and the left-eyeoptical system 301L. The imaging unit 211 converts a formed object image(light signal) into an analog electric signal. By using the lens unit300 (the right-eye optical system 301R and the left-eye optical system301L) in this manner, it is possible to acquire one image (dual-lensimage) including two image regions having parallax. When the acquiredimage is divided into a left-eye image and a right-eye image to beVR-displayed, the user is enabled to view a stereoscopic VR image in therange of approximately 180 degrees. That is, the user is enabled tostereoscopically view an image in VR180 format.

In the case of a normal single-lens unit, video (optical image) incidenton the lens unit is point-symmetrically inverted about the light axis ofthe lens unit and input to an imaging element (imaging sensor). Animaging device such as the camera 100 is enabled to generate an imagewithout a sense of discomfort (that is, a non-inverted image) bycontrolling the reading order of a signal from the imaging element or byperforming the inversion processing of a read signal (image). In thecase of a dual-lens unit, video is vertically inverted and input to animaging element but is not inverted horizontally. Accordingly, a leftimage and a right image are input to the imaging element with the leftimage incident via a left-eye optical system arranged on a left side andthe right image incident via a right-eye optical system arranged on aright side. Therefore, when the same inversion processing as thatperformed in the single-lens unit is performed, the right and left sidesof the camera 100 become opposite to the right and left sides of animage after the inversion processing. That is, an image in which aleft-image region corresponding to a left image is arranged on the rightside and a right-image region corresponding to a right image is arrangedon the left side is generated.

Here, a VR image refers to an image capable of being VR-displayed thatwill be described later. The VR image includes an omnidirectional image(a celestial sphere image) captured by an omnidirectional camera (acelestial sphere camera), a panoramic image having a video range (aneffective video range) wider than a display range capable of beingdisplayed on a display unit at a time, or the like. Further, the VRimage is not limited to a still image but also includes a moving imageand a live image (an image acquired from a camera in almost real time).The VR image has a video range (an effective video range) with a visualfield of 360 degrees in a right-and-left direction and a visual field of360 degrees in a top-and-bottom direction at maximum. Further, even in arange less than 360 degrees in the right-and-left direction and lessthan 360 degrees in the top-and-bottom direction, the VR image alsoincludes an image at a viewing angle wider than a viewing angle at whichthe capturing of an image is enabled by a normal camera or a video rangewider than a display range capable of being displayed on a display unitat a time. An image captured by the camera 100 using the lens unit 300described above is a type of the VR image. The VR display of the VRimage is enabled by, for example, setting a display mode of a displaydevice (a display device on which the VR image is displayable) to a “VRview.” When the range of a part of a VR image at a viewing angle of 360degrees is displayed and the user changes the orientation of the displaydevice in the right-and-left direction (horizontal rotation direction),it is possible to move a display range and view an omnidirectional imageseamless in the right-and-left direction.

A VR display (VR view) refers to a display method (display mode) withwhich it is possible to change a display range in which video within avisual-field range corresponding to the orientation of a display deviceis displayed as a VR image. The VR display includes “single-lens VRdisplay (single-lens VR view)” in which a VR image is deformed(distortion correction) to be mapped on a virtual sphere to display oneimage. Further, the VR display includes “dual-lens VR display (dual-lensVR view)” in which a VR image for a right eye and a VR image for a lefteye are deformed to be mapped on a virtual sphere and displayed side byside in a right region and a left region, respectively. By performingthe “dual-lens VR display” using a VR image for a left eye and a VRimage for a right eye having parallax each other, it is possible tostereoscopically view the VR images. For example, when the user wears adisplay device such as an HMD (Head Mounted Display), video within avisual-field range corresponding to the direction of the face of theuser is displayed in both the single-lens VR display and the dual-lensVR display. For example, it is assumed that video within a visual-fieldrange about 0 degree (in a specific direction, for example, the north)in a right-and-left direction and 90 degrees (90 degrees from thezenith, that is, a horizontal level) in a top-and-bottom direction at acertain time is displayed as a VR image. When the orientation of thedisplay device is turned inside out (for example, when a direction inwhich a display surface is oriented is changed from the south to thenorth) from this state, a display range is changed so that video withina visual-field range about 180 degrees (in an opposite direction, forexample, the south) in the right-and-left direction and 90 degrees inthe top-and-bottom direction is displayed as the same VR image. That is,when the user turns his/her face from the north to the south (that is,when the user looks back) while wearing the HMD, video displayed on theHMD is also changed from video in the north to video in the south. Notethat a VR image captured using the lens unit 300 is an image in VR180format (180° image) obtained by capturing the range of approximately 180degrees in a forward direction and does not include video within therange of approximately 180 degrees in a backward direction. When such animage in VR180 format is VR-displayed and the orientation of a displaydevice is changed to a side on which video does not exist, a blankregion is displayed.

When a VR image is VR-displayed in this manner, the user is enabled toobtain a feeling (a sense of immersion) as if he/she were visuallypresent in the VR image (VR space). Note that a method for displaying aVR image is not limited to a method for changing the orientation of adisplay device. For example, a display range may be moved (scrolled)according to a user operation via a touch panel, a direction button, orthe like. Further, during VR display (a display mode “VR view”), adisplay range may be moved according to touch-move on a touch panel, adrug operation with a mouse or the like, the pressing of a directionbutton, or the like in addition to the change of the display rangeaccording to the change of an orientation. Note that a smart phoneattached to a VR goggle (a head mounted adapter) is a type of an HMD.

The image processing unit 214 is capable of performing false-colorprocessing as color conversion processing. By the false-colorprocessing, the colors of respective pixels of a captured image (animage captured by the imaging unit 211) are converted into colorscorresponding to the brightness levels (pixel values) of the pixels. Forthe false-color processing, a plurality of colors corresponding to aplurality of parts within the range of the pixel values, respectively,are determined in advance. By the false-color processing, the colors ofthe respective pixels of the captured image are converted according tothe corresponding relationship between the plurality of parts within therange of the pixel values and the plurality of colors. FIG. 4 shows anexample of the meanings of respective colors (conversion colors) afterthe false-color processing. In the example of FIG. 4 , gradation valuesare 8-bit values, the color of a white region (including anwhite-saturation region) having a gradation value of 255 is convertedinto red, the color of a gray region having a gradation value of atleast 193 and not more than 254 is converted into yellow, and the colorof a gray region having a gradation value of at least 129 and not morethan 192 is converted into peach. Further, the color of a gray regionhaving a gradation value of at least 65 and not more than 128 isconverted into green, the color of a gray region having a gradationvalue of at least 1 and not more than 64 is converted into blue, and thecolor of a black region (including a black-saturation region) having agradation value of 0 is converted into purple. Note that the example inwhich the achromatic colors are converted into the chromatic colors isdescribed above. However, chromatic colors may be converted intoachromatic colors, or chromatic colors may be converted into otherchromatic colors.

As described above, a dual-lens image includes image regions (aright-image region and a left-image region) and a non-image region. In acaptured image including image regions and a non-image region, theboundaries between the image regions and the non-image region areunclear in some cases. For example, when green portions of image regionsare dark and a non-image region is black, the boundaries between theimage regions and the non-image region become unclear. Further, whenpredetermined image processing such as false-color processing isperformed on (to) a captured image including image regions and anon-image region, the predetermined image processing is performed notonly on the image regions but also on the non-image region. In thepresent embodiment, these problems are solved, and an image (a capturedimage, an image after predetermined image processing, or the like) basedon a captured image including image regions and a non-image region isdisplayed in a suitable state.

First Embodiment

In a first embodiment, an image after predetermined image processing isdisplayed in a state where predetermined image processing is performedon image regions and is not performed on a non-image region. Forexample, the image processing unit 214 does not perform predeterminedimage processing on a non-image region and performs the predeterminedimage processing on image regions. The image processing unit 214performs false-color processing as the predetermined image processing.FIG. 5 shows an example of a display image (an image displayed on thedisplay unit 108 or the EVF 217) according to the first embodiment. InFIG. 5 , the color of a black-saturation region 504 of a right-imageregion 502 and the color of a black-saturation region 505 of aleft-image region 503 are converted into other colors by false-colorprocessing. On the other hand, the color of a non-image region 501 isnot converted from black. In FIG. 5 , image regions (the right-imageregion 502 and the left-image region 503) are regions inside imagecircles, and the non-image region 501 is a region outside the imagecircles.

FIG. 6 is a flowchart showing an example of LV display processingaccording to the first embodiment. The LV display processing is realizedwhen the system control unit 50 develops the program recorded on thenon-volatile memory 219 into the system memory 218 and runs thedeveloped program. The LV display processing of FIG. 6 starts, forexample, when the camera 100 is activated in a photographing mode orwhen a mode of the camera 100 is switched to the photographing mode.

In step S601, the system control unit 50 determines whether a lens unitattached to the camera 100 is a dual-lens unit (for example, the lensunit 300). The processing proceeds to step S602 when the dual-lens unitis attached to the camera 100. Otherwise, the processing proceeds tostep S603.

In step S602, the system control unit 50 acquires mask information (maskinformation showing the presence of a mask) corresponding to thedual-lens unit attached to the camera 100. The mask information is, forexample, information showing at least one of image regions and anon-image region.

For example, a plurality of mask information corresponding to aplurality of dual-lens units is recorded in advance on the non-volatilememory 219. The system control unit 50 acquires lens information (forexample, identification information such as an ID) on the dual-lens unitattached to the camera 100 from the dual-lens unit (informationacquisition) and reads mask information corresponding to the acquiredlens information from the non-volatile memory 219. The system controlunit 50 may perform communication (for example, wireless communication)with external equipment (for example, a server on the Internet) andacquire (download) mask information corresponding to the acquired lensinformation from the external equipment. The lens information mayinclude information showing the positions or diameters of image circles,and the system control unit 50 may generate mask information on thebasis of the lens information. The above processing is graspable asprocessing to determine at least one of image regions and a non-imageregion on the basis of the lens information (region determination). Thesystem control unit 50 may determine at least one of image regions and anon-image region by analyzing a captured image and generate maskinformation according to the result of the determination.

In step S603, the system control unit 50 acquires mask informationshowing the absence of a mask.

In step S604, the system control unit 50 acquires a captured image (liveimage) from the imaging unit 211 (image acquisition).

In step S605, the system control unit 50 determines whether afalse-color function (a function to perform false-color processing) hasbeen set effective. The processing proceeds to step S606 when thefalse-color processing has been set effective. Otherwise, the processingproceeds to step S607.

In step S606, the system control unit 50 determines regions where thefalse-color processing is to be performed (applied) using the maskinformation acquired in step S602 or step S603. When the maskinformation has been acquired in step S602, the system control unit 50determines image regions as regions where the false-color processing isto be performed so that the false-color processing is not performed on anon-image region. When the mask information has been acquired in stepS603, the system control unit 50 determines the whole captured image asa region where the false-color processing is to be performed. Then, thesystem control unit 50 controls the image processing unit 214 so thatthe false-color processing is performed on the regions determined usingthe mask information in the captured image acquired in step S604. Thus,an image after the false-color processing is obtained as an output image(display image).

In step S607, the system control unit 50 controls the image processingunit 214 so as not to perform the false-color processing. Thus, thecaptured image acquired in step S604 (the image on which the false-colorprocessing has not been performed) is obtained as an output image(display image). Note that image processing different from thefalse-color processing may be performed on the output image.

In step S608, the system control unit 50 displays the output imageobtained in step S606 or step S607 on the display unit 108 or the EVF217. Note that the output image may be displayed on an external monitor.

In step S609, the system control unit 50 determines whether to end theLV display (LV display processing). The LV display processing of FIG. 6ends when the system control unit 50 ends the LV display. Otherwise, theprocessing proceeds to step S610. For example, the system control unit50 ends the LV display processing of FIG. 6 when instructions to turnoff the power of the camera 100 (instructions to press the power switch102), instructions to switch a mode of the camera 100 from aphotographing mode to another mode (instructions to press the modeselection switch 103), or the like are provided.

In step S610, the system control unit 50 determines whether the lensunit attached to the camera 100 has been changed. The processingproceeds to step S604 when the lens unit has not been changed.Otherwise, the processing proceeds to step S601.

As described above, according to the first embodiment, predeterminedimage processing is not performed on a non-image region, and isperformed on image regions. Thus, it is possible to display an image,after a predetermined image processing (for example, false colorprocessing) to a captured image including image regions and a non-imageregion, in a suitable state where a boundary between an image region andnon-image region is easily distinguishable.

Note that the predetermined image processing is not limited tofalse-color processing but may be, for example, patterning processing(processing to convert the pattern of a specific region into apredetermined pattern such as a zebra pattern), sharpening processing,various filter processing, or the like.

Further, a captured image where predetermined image processing isperformed only on image regions is not limited to an image capturedusing a dual-lens unit but may be, for example, an image captured usinganother multi lens unit (triple-lens unit). A captured image wherepredetermined image processing is performed only on image regions may bean image captured using a monocular fish-eye lens or the like. An imagewhere predetermined image processing is performed only on image regionsis not limited to an image captured using a fish-eye lens but may be apanoramic image in letter-box format captured using a standardwide-angle lens, or the like.

Second Embodiment

In a second embodiment as well, an image after predetermined imageprocessing is displayed in a state where the predetermined imageprocessing is performed on image regions and is not performed on anon-image region. The first embodiment describes an example in whichpredetermined image processing is not performed on a non-image regionand is performed on image regions. In the second embodiment,predetermined image processing is performed on the whole captured image,and an image after the predetermined image processing is displayed witha predetermined mask (a mask image or a graphic) superimposed on anon-image region.

FIG. 7 is a flowchart showing an example of LV display processingaccording to the second embodiment. The LV display processing isrealized when the system control unit 50 develops the program recordedon the non-volatile memory 219 into the system memory 218 and runs thedeveloped program. The LV display processing of FIG. 7 starts, forexample, when the camera 100 is activated in the photographing mode or amode of the camera 100 is switched to the photographing mode.

In step S701, the system control unit 50 acquires a captured image (liveimage) from the imaging unit 211.

In step S702, the system control unit 50 determines whether thefalse-color function has been set effective. The processing proceeds tostep S704 when the false-color function has been set effective.Otherwise, the processing proceeds to step S703.

In step S703, the system control unit 50 displays the captured imageacquired in step S701 on the display unit 108 or the EVF 217.

In step S704, the system control unit 50 controls the image processingunit 214 so that false-color processing is performed on the wholecaptured image acquired in step S701.

In step S705, the system control unit 50 determines whether a lens unithaving been attached to the camera 100 is a dual-lens unit. Theprocessing proceeds to step S706 when the dual-lens unit has beenattached to the camera 100. Otherwise, the processing proceeds to stepS707.

In step S706, the system control unit 50 controls the image processingunit 214 and superimposes a mask corresponding to the dual-lens unitattached to the camera 100 on a false-color image (an image after thefalse-color processing in step S704). The mask is superimposed on thefalse-color image so as to cover a non-image region. Then, the systemcontrol unit 50 displays the false-color image on which the mask hasbeen superimposed on the display unit 108 or the EVF 217.

In step S707, the system control unit 50 displays the false-color imageon which the mask has not been superimposed on the display unit 108 orthe EVF 217.

In step S708, the system control unit 50 determines whether to end theLV display (LV display processing). The LV display processing of FIG. 7ends when the system control unit ends the LV display. Otherwise, theprocessing proceeds to step S701.

As described above, predetermined image processing is performed on thewhole captured image, and an image after the predetermined imageprocessing is displayed with a predetermined mask superimposed on anon-image region according to the second embodiment. Thus, it ispossible to display an image, after a predetermined image processing(for example, false color processing) to a captured image includingimage regions and a non-image region, in a suitable state where aboundary between an image region and non-image region is easilydistinguishable.

Third Embodiment

In a third embodiment, an image based on a captured image (such as acaptured image and an image after predetermined image processing) isdisplayed in a state where the boundaries between image regions and anon-image regions are emphasized (highlighted). For example, the imageprocessing unit 214 superimposes the boundary lines (boundary images orgraphics) between image regions and a non-image region on an image basedon a captured image. FIG. 8 shows an example of a display imageaccording to the third embodiment. In FIG. 8 , a boundary line 804between a right-image region 802 and a non-image region 801 and aboundary line 805 between a left-image region 803 and the non-imageregion 801 are drawn. In FIG. 8 , the image regions (the right-imageregion 802 and the left-image region 803) are regions inside imagecircles, and the non-image region 801 is a region outside the imagecircles. Note that an example in which predetermined image processingsuch as false-color processing is not performed will be described butthe predetermined image processing may be performed in the same manneras the first and second embodiments or the like.

FIG. 9 is a flowchart showing an example of LV display processingaccording to the third embodiment. The LV display processing is realizedwhen the system control unit 50 develops the program recorded on thenon-volatile memory 219 into the system memory 218 and runs thedeveloped program. The LV display processing of FIG. 9 starts, forexample, when the camera 100 is activated in the photographing mode or amode of the camera 100 is switched to the photographing mode.

In step S901, the system control unit 50 acquires a captured image (liveimage) from the imaging unit 211.

In step S902, the system control unit 50 determines whether a lens unithaving been attached to the camera 100 is a dual-lens unit. Theprocessing proceeds to step S903 when the dual-lens unit has beenattached to the camera 100. Otherwise, the processing proceeds to stepS904.

In step S903, the system control unit 50 controls the image processingunit 214 and superimposes boundary lines (boundary lines between imageregions and a non-image region) corresponding to the dual-lens unitattached to the camera 100 on the captured image acquired in step S901.Then, the system control unit 50 displays the captured image on whichthe boundary lines have been superimposed on the display unit 108 or theEVF 217.

In step S904, the system control unit 50 displays the captured imageacquired in step S901 (the captured image on which the boundary lineshave not superimposed) on the display unit 108 or the EVF 217.

In step S905, the system control unit 50 determines whether to end theLV display (LV display processing). The LV display processing of FIG. 9ends when the system control unit 50 ends the LV display. Otherwise, theprocessing proceeds to step S901.

As described above, the boundaries between image regions and a non-imageregion are emphasized according to the third embodiment. Thus, it ispossible to display an image, after a predetermined image processing(for example, false color processing) to a captured image includingimage regions and a non-image region, in a suitable state where aboundary between an image region and non-image region is easilydistinguishable.

Note that the colors, brightness, line types, or the like of boundarylines are not particularly limited so long as they are capable of makingthe boundaries between image regions and a non-image region conspicuous.For example, the colors or brightness of boundary lines may be changedaccording to the colors or brightness of image regions.

Further, a method for highlighting the boundaries between image regionsand a non-image region (making the boundaries conspicuous) is notlimited to a method in which boundary lines are superimposed. Forexample, a non-image region may be painted with a color not used insideimage regions, or the pattern of a non-image region may be convertedinto a predetermined pattern such as a zebra pattern.

Note that the various control described above as being performed by thesystem control unit 50 may be performed by one hardware, or processingmay be borne by a plurality of hardware (for example, a plurality ofprocessors or circuits) to control the whole device.

Further, the embodiments of the present invention are described indetail above. However, the present invention is not limited to thespecific embodiments, and various modes are also included in the presentinvention within the scope of the present invention. Moreover, each ofthe embodiments described above shows only one embodiment of the presentinvention, and the embodiments may be appropriately combined together.

Further, the present invention is applicable not only to cameras(imaging devices) but also to electronic equipment (display controldevices) so long as they are capable of performing the display controlof images. For example, the present invention is applicable to personalcomputers, PDAs, mobile telephone terminals, mobile image viewers,printer devices, digital photo frames, music players, game machines,electronic book readers, or the like. Further, the present invention isapplicable to video players, display devices (including projectiondevices), tablet terminals, smart phones, AI speakers, home-electricdevices, in-vehicle devices, or the like. The present invention isapplicable also to multi-lens smart phones having a plurality ofdifferent types of optical systems such as a standard lens, a wide-anglelens, and a zoom lens. In this case as well, it is possible to obtain astereoscopically-viewable image by performing photographing with thefocal distances (zoom magnifications) of two used optical systemsmatched (made common) to each other.

Further, the present invention is applicable not only to imaging devicebodies but also to control devices that communicate with imaging devices(including network cameras) via wired or wireless communication andremotely control the imaging devices. The control devices that remotelycontrol the imaging devices include, for example, devices such as smartphones, tablet PCs, and desktop PCs. By notifying the imaging devices ofa command for performing various operations or settings from the controldevices on the basis of operations or processing performed by thecontrol devices, it is possible to remotely control the imaging devices.Further, live-view images photographed by the imaging devices may bereceived via wired or wireless communication and displayed on thecontrol devices.

According to the present invention, it is possible to display an imagebased on a captured image including image regions and a non-image regionin a suitable state.

OTHER EMBODIMENTS

Embodiment(s) of the present invention can also be realized by acomputer of a system or apparatus that reads out and executes computerexecutable instructions (e.g., one or more programs) recorded on astorage medium (which may also be referred to more fully as a‘non-transitory computer-readable storage medium’) to perform thefunctions of one or more of the above-described embodiment(s) and/orthat includes one or more circuits (e.g., application specificintegrated circuit (ASIC)) for performing the functions of one or moreof the above-described embodiment(s), and by a method performed by thecomputer of the system or apparatus by, for example, reading out andexecuting the computer executable instructions from the storage mediumto perform the functions of one or more of the above-describedembodiment(s) and/or controlling the one or more circuits to perform thefunctions of one or more of the above-described embodiment(s). Thecomputer may comprise one or more processors (e.g., central processingunit (CPU), micro processing unit (MPU)) and may include a network ofseparate computers or separate processors to read out and execute thecomputer executable instructions. The computer executable instructionsmay be provided to the computer, for example, from a network or thestorage medium. The storage medium may include, for example, one or moreof a hard disk, a random-access memory (RAM), a read only memory (ROM),a storage of distributed computing systems, an optical disk (such as acompact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™),a flash memory device, a memory card, and the like.

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all such modifications and equivalent structures andfunctions.

This application claims the benefit of Japanese Patent Application No.2022-098053, filed on Jun. 17, 2022, which is hereby incorporated byreference herein in its entirety.

What is claimed is:
 1. A display control device comprising: a processor;and a memory storing a program which, when executed by the processor,causes the display control device to acquire a captured image includinga first image region and a second image region, wherein the first imageregion is inside an image circle and the second image region is outsidethe image circle, perform predetermined image processing on the capturedimage, and perform control so that an image after the predeterminedimage processing is displayed in a state where the predetermined imageprocessing is performed on the first image region and is not performedon the second image region so as to be distinguishable a boundarybetween the first image region and the second image region.
 2. Thedisplay control device according to claim 1, wherein the predeterminedimage processing is color conversion processing.
 3. The display controldevice according to claim 2, wherein a plurality of colors correspondingto a plurality of pixel values, respectively, are determined in advance,and the color conversion processing is false-color processing to convertcolors of respective pixels of the captured image according to acorresponding relationship between the plurality of pixel values and theplurality of colors.
 4. The display control device according to claim 1,wherein the predetermined image processing is not performed on thesecond image region, and the predetermined image processing is performedon the first image region.
 5. The display control device according toclaim 1, wherein the predetermined image processing is performed onwhole of the captured image.
 6. The display control device according toclaim 1, wherein the control is performed so that the image after thepredetermined image processing is displayed in a state where thepredetermined image processing is not performed on the second imageregion by superimposing a predetermined mask on the second image region.7. The display control device according to claim 1, wherein the controlis performed so that the image after the predetermined image processingis displayed with a boundary line between the first image region and thesecond image region superimposed thereon.
 8. The display control deviceaccording to claim 1, wherein the captured image is an image capturedusing a multi lens unit and the captured image includes a plurality ofimage circles.
 9. The display control device according to claim 1,wherein the captured image is an image captured using a multi fish-eyelens unit and the captured image includes a plurality of image circles.10. The display control device according to claim 1, wherein, when theprogram is executed by the processor, the program further causes thedisplay control device to determine at least one of the first imageregion and the second image region by analyzing the captured image. 11.The display control device according to claim 1, wherein, when theprogram is executed by the processor, the program further causes thedisplay control device to acquire information on a lens unit used tocapture the captured image, and determine at least one of the firstimage region and the second image region on a basis of the information.12. A display control method comprising: acquiring a captured imageincluding a first image region and a second image region, wherein thefirst image region is inside an image circle and the second image regionis outside the image circle, performing predetermined image processingon the captured image, and performing control so that an image after thepredetermined image processing is displayed in a state where thepredetermined image processing is performed on the first image regionand is not performed on the second image region so as to bedistinguishable a boundary between the first image region and the secondimage region.
 13. A non-transitory computer readable medium that storesa program, wherein the program causes a computer to execute a displaycontrol method comprising: acquiring a captured image including a firstimage region and a second image region, wherein the first image regionis inside an image circle and the second image region is outside theimage circle, performing predetermined image processing on the capturedimage, and performing control so that an image after the predeterminedimage processing is displayed in a state where the predetermined imageprocessing is performed on the first image region and is not performedon the second image region so as to be distinguishable a boundarybetween the first image region and the second image region.